An improved Monte Carlo Tree Search approach to workflow scheduling
نویسندگان
چکیده
Workflow computing has become an essential part of many scientific and engineering fields, while workflow scheduling long been a well-known NP-complete research problem. Major previous works can be classified into two categories: heuristic-based guided random-search-based methods. Monte Carlo Tree Search (MCTS) is recently proposed search methodology with great success in AI on game playing, such as Computer Go. However, researchers found that MCTS also potential application other domains, including combinatorial optimization, task scheduling, planning, so on. In this paper, we present new approach based MCTS, which still rarely explored direction. Several mechanisms are developed for the major steps to improve execution schedules further. Experimental results show our outperforms methods significantly terms makespan.
منابع مشابه
Monte-Carlo Tree Search
representation of the game. It was programmed in LISP. Further use of abstraction was also studied by Friedenbach (1980). The combination of search, heuristics, and expert systems led to the best programs in the eighties. At the end of the eighties a new type of Go programs emerged. These programs made an intensive use of pattern recognition. This approach was discussed in detail by Boon (1990)...
متن کاملImproved Monte-Carlo Search
Monte-Carlo search has been successful in many non-deterministic games, and recently in deterministic games with high branching factor. One of the drawbacks of the current approaches is that even if the iterative process would last for a very long time, the selected move does not necessarily converge to a game-theoretic optimal one. In this paper we introduce a new algorithm, UCT, which extends...
متن کاملAn Analysis of Monte Carlo Tree Search
Monte Carlo Tree Search (MCTS) is a family of directed search algorithms that has gained widespread attention in recent years. Despite the vast amount of research into MCTS, the effect of modifications on the algorithm, as well as the manner in which it performs in various domains, is still not yet fully known. In particular, the effect of using knowledgeheavy rollouts in MCTS still remains poo...
متن کاملA Monte Carlo Tree Search approach to Active Malware Analysis
Active Malware Analysis (AMA) focuses on acquiring knowledge about dangerous software by executing actions that trigger a response in the malware. A key problem for AMA is to design strategies that select most informative actions for the analysis. To devise such actions, we model AMA as a stochastic game between an analyzer agent and a malware sample, and we propose a reinforcement learning alg...
متن کاملAdapting Improved Upper Confidence Bounds for Monte-Carlo Tree Search
The UCT algorithm, which combines the UCB algorithm and Monte-Carlo Tree Search (MCTS), is currently the most widely used variant of MCTS. Recently, a number of investigations into applying other bandit algorithms to MCTS have produced interesting results. In this research, we will investigate the possibility of combining the improved UCB algorithm, proposed by Auer et al. [2], with MCTS. Howev...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Connection science
سال: 2022
ISSN: ['0954-0091', '1360-0494']
DOI: https://doi.org/10.1080/09540091.2022.2052265